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FRICATIVES 
Novelty Processing 
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FIG. 4 

Coincidence Processing. The output size is 576 
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FIG. 5 



VOWELS 
Novelty processing. 
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FIG. 6 

Coincidence Processing. The output size is 696. 
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FIG. 7 



NONFRICATIVES 
Novelty Processing. 



Channel 


Center 
Start 


Center 
Length 


Center 
Width 


Alpha 


Surround 
Start 


Surround 
Length 


Surround 
Width 


0 


4 


4 




1.0 


3 


2 


3 


1 


4 


4 


8 


0.6 


0 


Ail 


1 


2 


0 


2 


1 


1.1 


0 


3 


10 


3 


6 


6 


4 


0.7 


0 


All 


1 


4 


1 


2 


2 


0.6 


0 


All 


1 


5 


1 


4 


6 


1.2 


10 


20 


8 



FIG. 8 



Coincidence Processing. The output size is 697. 



Function 


Attention 
Trigger 


Delta 


Start 


Stop 


Width 


Novelty 
Channel 


eCrossColumn 


eDeltaPlus 


-7 


7 


16 


10 


— 


eCrossColumn 


eMinus 


0 


0 


23 


10 


° 


eCrossColumn 




-2 


2 


24 


— 


° 


eCrossColumn 


ePIus 


-7 


7 


17 


6 


J 


eCrossColumn 


eDeltaPlus 


-1 


14 


24 


10 




eCrossColumn 


eDeltaPlus 










2 


eCrossColumn 


eDeltaMinus 


0 


0 


24 


4 


2 


eCrossColumn 


eDeltaPlus 


-1 


1 


24 


13 


2 


eCrossColumn 


ePIus 


2 


0 


18 


10 


4 


eCrossColumn 


eMinus 


-5 


10 


24 


5 


5 


selfAddLocalFreq 


ePIus 




4 


18 


17 


0 


selfAddLocalFreq 


eDeltaMinus 




0 


24 


5 


0 


selfAddLocalFreq 


eDeltaPlusM2 




5 


23 


6 


1 


selfAddLocalFreq 






1 


24 


4 


2 


crossAddLocalFreq 


eMinus 


3 


0 


21 


5 


0 


crossAddLocalFreq 


ePIus 


-2 


2 


24 


12 


0 


crossAd d Local F req 




-4 


4 


24 


6 


2 


crossAddLocalFreq 




1 


0 


23 


5 


2 


crossAddLocalFreq 




-2 


2 


24 


5 


3 


crossAddLocalFreq 


eDeltaPlus 




0 


23 


6 




crossAddLocal Freq 




-4 


4 


24 


9 


4 


crossAddLocalFreq 




-7 • 


7 


24 


8 


4 


crossAddLocal Freq 


eDeltaPlus 


-2 


2 


24 


3 




crossAddLocal Freq 


eDeltaPlusP2 


-3 


3 


24 


10 




crossAddLocal Freq 




-6 


6 


24 


13 


5 


crossAddLocal Freq 


eDeltaPlus 


2 


9 


22 


13 


5 



FIG. 9 
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FIG. 10 



Default signal flow is from one line to the next. 
The general syntax is: 

inputl:, input2: — > processName — > output: with/from/to parameter-list 

putinmaxflo — > 

— > mu_lawRT — > mu: 

mu: — >procrustes — > spf: with 192 192 

mu: — > echocancel — > input: with cancel 1 

input: — >chunkify — > with 128 32 

— > remove_mean — > rem: 

— > mvmultiply — > dft: with Four4_57.tab 

— > cvpower — > cvp: 

cvp: — > procrustes — > with 154 

— > record_stats — > eng: with sum no_normalize 
cvp: — > hanning — > han: 

— > procrustes — > with 1 54 

— > compress — > c: with normalize 1111111111 1111111111 111 
111 22222222222222-1 
eng: ,c: — > concatenate — > 

— >log2 — >log40: with 1.0 

log40: — >noveltyRT— > with vowels 

— > normalize — > with no mulvowels.log40 silvowels.log40 

,eng: — > zeroOnLow — > with 0.0 

— > extract — > ev: with 3 24 12 

ev: — > eTrigger — > tv: with 6 24 41 

ev:, tv: — > coincidenceRT — > with 6 24 41 vowels 

— > normalize — > v: with no muvowels.p4 sivowels.p4 

log40: — > noveltyRT — > with fricatives 

— > normalize — > with no mulfricatives.log40 silfricatives.log40 

,eng: — > zeroOnLow — > with 0.0 

-- > extract — > ef: with 3 24 12 

ef: — > eTrigger — >tf: with 6 2441 

ef:, tf: -- > coincidenceRT — > with 6 24 41 fricatives 

— > normalize — > f: with no mufricatives.p4 sifricatives.p4 

log40: — > noveltyRT --> with nonfricatives 

— > normalize — > with no mulnonfricatives.log40 silnonfricatives.log40 

,eng: — > zeroOnLow — > with 0.0 

-- > extract - > en: with 3 24 12 

en: — > eTrigger — > tn: with 6 24 41 

en:, tn: — > coincidenceRT — > with 6 24 41 nonfricatives 

— > normalize — > nf: with no munonfricatives.p4 sinonfricatives.p4 
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v:, f: — > concatenate — > 
, nf: — > concatenate — > 

— > mean_square_norm — > ms: with yes yes 

ms: — >mv_multiply — > with k.GA _ 

— >map — > with npllr.GA 

— > nBest — >best: with 7 

eng: — > extract — > with 3 24 23 

— > record_stats — > eLong: with sum normalize 

eLong: — > log2 --- > with 1.0 

,best: — > scale — > ebest: with long 1000.0 200.0 

spf: — > delay -> with 11 

— > extract — > with 3 1 0 

— > scale — > sps: with long 

sps:,ebest: — > concatenate — > 
— > putoutAS 
stop 
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List of Processes 



chunkify 

coincidertceRT 

compress 

concatenate 

cvpower 

delay 

eTrigger 

echocancel 

extract 

hanning 

log2 

map 

mean_square_norm 

muJawRT 

mv_multiply 

nBest 

normalize 

noveltyRT 

putinmaxflo 

putoutAS 

record_stats 

remove_mean 

procrustes 

zeroOnLow 

Parameter Files 

Four4_57.tab 
k.GA 

mu1 fricatives. Iog40 

mu1 nonfricatives.log40 

mu1vowels.log40 

mufricatives.p4 

munonfricatives.p4 

muvowels.p4 

npltr.GA 

si1fricatives.log40 

si1 nonfricatives.log40 

si1vowels.log40 

sifricatives.p4 

sinonfricatives.p4 

sivowels.p4 



aggregates the sound data stream into overlapping segments 
see main text 

aggregates each data vector into the given bins by averaging over bin 
concatenates each pair of incoming vectors into one output vector 
computes power spectrum from complex DFT spectrum 
delays a data stream 
see main text 

performs echocancelling using voice in and voice out streams 
extracts a time window of specified width and decimation 
standard hanning filter 
log base2 

applies a nonlinear, pointwise transform as specified by control file 

■ normalizes each vector by mean and standard deviation 

• inverse mu-law 

• matrix-vector multiply 

■ zeros out all but the N highest elements of a vector 

• subtracts constant mean vector, and divides by a constant scale vector 

■ see main text 

- provides input data stream from system 

- accepts output phonetic stream to pass on to rest of system 

- computes mean and sigma for each vector 

- subtracts the vector mean from each vector 

- selects a contiguous central portion of a vector 

- zeros a vector according to empirical low energy condition 



- Fourier coefficient matrix 

- matrix of phonetic vector-coefficients 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- constant mean vector 

• specifies nonlinear transform to create log-likelihood ratio output 

- constant scale vector 

- constant scale vector 

- constant scale vector 

- constant scale vector 

- constant scale vector 

- constant scale vector 
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The ScaleMean object as referenced by normalizeRT. 

#include "StdAfx.h" 
#include <stdlib.h> 
#include <stdio.h> 
#include <assert.h> 
#include <math.h> 



#define MAX_MEM 100 

class ScaleMean 
{ 

Zbuffer *buf0; 

int start; 

int length; 

int width; 

int numberlnBufO; 

float* flnTimef MAX_MEM ]; 

public: 

ScaleMean(); 
float get( int i ); 

void init( Zipper* aZipper, int aStart, int aLength, int aWidth); 
void update( Zipper* zl ); 
float sides( Zipper* zl, int i ); 

}; 



ScaleMean: :ScaleMean() 
{ 

bufO = NULL; 

} 

void ScaleMean: :init( Zipper* aZipper, int aStart, int aLength, int aWidth) 
{ 

start = aStart; 
length = aLength; 
width = aWidth; 
numberlnBufO = 0; 
if(bufO==NULL) 

bufO = new Zbuffer ( "bufO", aZipper->getType(), aZipper->getSize(), 

start+length ); 
else 

buf0->zero(); 

} 
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float ScaleMean::sides( Zipper* zl, int i ) 
{ 

float sidesSum = (float) 0.0; 
float sidesMean; 

float* pf = (float*) zl->getData(); 

// Energy has no sides 
if(i = 0) 

return pf[0]; 

int n = 0; 

int size = (int) zl->getSize(); 
// Add in sides where possible, 
int f = max( 1, i - width ); 
int fEnd = min( size-1, i + width ); 
while ( f <= fEnd ) { 

sidesSum +=pf[f++]; 

n++; 

} 

sidesMean = (float) quo( sidesSum, ( float ) n ); 
return sidesMean; 

} 

void ScaleMean::update( Zipper* zl ) 
{ 

buf0->update(); 

Zipper* zO = buf0->get( buf0->getLength()-l ); 
float *pf = (float*) zO->getData(); 
for ( long i = 0; i < (long) zl->getSize(); i++ ) { 
pf[i] = sides( zl, i ); 

} 

if (numberlnBufO < (int) bufO->getLength()) numberInBufO++; 

int len = bufO->getLength(); 

for (int j = 0; j <len;j++) 

{ // Find the time in the past. 

Zipper *pz0 = buf0->get(len - 1 - j ); 

flnTime[ j ] = ( float* ) pz0->getData(); 

} 

} 
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float ScaleMean::get( int i ) 
{ 

float scaleSum = (float) 0.0; 
float scaleMean; 



// Just average over the ones we actually have, 
float n = 0.0; 

for ( int j = start; j < numberlnBufO; j++ ) { 
float* fin = flnTime[j]; 
scaleSum += fln[i]; 
n++; 
} 

scaleMean = (float) quo( scaleSum, n ); 
return scaleMean; 
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The NoveltyRT process. See Attachment 2 for the definition of the ScaleMean object- 
Usage - 

data:, speaking: — > NoveltyRT — > with whichLabelset 

*/ 

#include "StdAfx.h" 
#include <stdlib.h> 
#include <stdio.h> 
#include <assert.h> 
#include <math.h> 

#include "speedObject.h" 
#include "scalemean.h" 

#defme MAX_SCALES 10 

class NoveltyRT : public SpeedProcess 
{ 

public: 

NoveltyRTO; 
~NoveltyRT(); 

int begin 0; 

int beginFile(Zipper* zl, Zipper* z2 ); 

Zipper* processZipper( Zipper* zl, Zipper* z2 ); 

Zipper* finalFileZipper (); 

void accumMeanAllTimeO; 

float getScaleMeanAHTime( int i ); 

void universal( int size, ScaleMean* center, ScaleMean* surround, double alpha ); 

private: 

Zbuffer *buf0; 

int numberOfScales; 
int outSize; 
int whichFlavor; 
BOOL bSpeaking; 

ScaleMean* cScales[ MAX_SCALES ]; 
ScaleMean* sScalesf MAX_SCALES ]; 
double alpha[ MAX_SCALES ]; 

Zbuffer *allTimeSum; 
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Zipper* pZallTimeSum; 

float allTimeCount; 



int iout; 

Zipper* theZout; 

void put( double x ) { theZout->put( iout++, x ); } ; 



NoveltyRT::NoveltyRT() : SpeedProcess( "NoveltyRT" ) 

allTimeSum = NULL; 
bufD = NULL; 



NoveltyRT: :~NoveltyRT() 
delete allTimeSum; 



/* NoveltyRT - called from initNet() in netnode.cpp 
* whenever a node is created for this process. 

*/ 

SpeedObject* noveltyRT() 

return (new NoveltyRT); 



int NoveltyRT: :begin () 

whichFlavor = (int) parameters->askWords( "fricatives nonfricatives vowels" ); 
allTimeSum = NULL; 
bufO - NULL; 

for ( int i=0; i < MAX_SCALES; i++ ) { 
cScales[i] = NULL; 
sScales[i] = NULL; 

} 

return TRUE; 

} 

Zipper* NoveltyRT: :finalFileZipper () 
{ 

cout « "Spectrum for Transaction:" « endl; 
if ( allTimeCount >0 ) 

for ( int i = 0; i < pZallTimeSum->getSize(); i++ ) 

cout « pZallTimeSum->get(i)/allTimeCount « " "; 
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cout « endl; 



dataState = BUFEOT; 
return NULL; 

} 

intNoveltyRT::beginFile(Zipper* zl, Zipper* z2) 
{ 

assert( zl->getType() = ELIZAFLOAT ); 
for ( int i=0; i < MAX_SCALES; i++ ) { 

delete cScales[i]; 

delete sScales[i]; 

cScales[i]=NULL; 

sScales[i] = NULL; 

} 



// FRICATIVES 

if ( whichFlavor = 0 ) { 

numberOfScales = 6; 

cScales[0] = new ScaleMean(); 

cScales[0]->init( zl, 10, 6, 1 ); 

sScales[0] = NULL; 

alpha[0] = 0.6; 

cScales[l] = new ScaleMean(); 
cScales[l]->init( zl, 4, 3, 8 ); 
sScales[l] = new ScaleMean(); 
sScales[l]->init( zl, 6, 8, 3 ); 
alpha[l] = 0.7; 

cScales[2] = new ScaleMean(); 
cScales[2]->init( zl, 0, 4, 2 ); 
sScales[2] = new ScaleMean(); 
sScales[2]->init( zl, 1, 8, 10 ); 
alpha[2] = 0.7; 

cScales[3] = new ScaleMean(); 
cScales[3]->init( zl, 1, 2, 2 ); 
sScales[3] = NULL; 
alpha[3] = 1.0; 

cScales[4] = new ScaleMean(); 
cScales[4]->init( zl, 10, 4, 4 ); 
sScales[4] = NULL; 
alpha[4] = 0.9; 
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cScales[5] = new ScaleMean(); 
cScales[5]->init( zl, 0, 1, 10 ); 
sScales[5] = new ScaleMean(); 
sScales[5]->init( zl, 4, 2, 14 ); 
alpha[5] = l.l; 



//VOWELS 

else if ( whichFlavor = 2 ) { 
numberOfScales = 6; 

cScales[0] = new ScaleMean(); 
cScales[0]->init( zl, 6, 4, 4); 
sScales[0] = new ScaleMean(); 
sScales[0]->init( zl, 0, 8, 4); 
alpha[0] = 0.6; 

cScales[l] = new ScaleMean(); 
cScales[l]->init( zl, 0, 2, 1 ); 
sScales[l] =NULL; 
alpha[l] = 1.0; 

cScales[2] = new ScaleMean(); 
cScales[2]->init( zl, 4, 6, 6 ); 
sScales[2] = NULL; 
alpha[2] = 0.9; 

cScales[3] = new ScaleMean(); 
cScales[3]->init( zl, 8, 6, 3 ); 
sScales[3] = new ScaleMean(); 
sScales[3]->init( zl, 8, 16, 20 ); 
alpha[3] = 0.8; 

cScales[4] = new ScaleMean(); 
cScales[4]->init( zl, 0, 3, 6 ); 
sScales[4] = new ScaleMean(); 
sScales[4]->init( zl, 2, 4, 14 ); 
alpha[4] - 1.2; 

cScales[5] = new ScaleMean(); 
cScales[5]->init( zl, 4, 1, 1 ); 
sScales[5] = new ScaleMean(); 
sScales[5]->init( zl, 2, 4, 12 ); 
alpha[5] = 0.9; 
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//NONFRICATIVES 

else if ( whichFlavor = 1 ) { 
numberOfScales = 6; 

cScales[0] = new ScaleMean(); 
cScales[0]->init( zl, 4, 4, 1 ); 
sScalesfO] = new ScaleMean(); 
sScales[0]->init( zl, 3, 2, 3 ); 
alpha[0] = 1.0; 

cScales[l] = new ScaleMean(); 
cScales[l]->init( zl, 4, 4, 8 ); 
sScales[l]=NULL; 
alpha[l] = 0.6; 

cScales[2] = new ScaleMean(); 
cScales[2]->init( zl, 0, 2, 1 ); 
sScales[2] = new ScaleMean(); 
sScales[2]->init( zl, 0, 3, 10 ); 
alpha[2] = l.l; 

cScales[3] = new ScaleMean(); 
cScales[3]->init( zl, 6, 6, 4 ); 
sScales[3]=NULL; 
alpha[3] = 0.7; 

cScales[4] = new ScaleMean(); 
cScales[4]->init( zl, 1, 2, 2 ); 
sScales[4] = NULL; 
alpha[4] = 0.6; 

cScales[5] = new ScaleMean(); 
cScales[5]->init( zl, 1, 4, 6 ); 
sScales[5] = new ScaleMean(); 
sScales[5]->init( zl, 10, 20, 8 ); 
alpha[5] = 1.2; 

} 

allTimeCount = (float) 0.0; 

outSize = zl->getSizeO * numberOfScales; 

if(bufO==NULL) 

^ // We need a min of 3 for finding energy in accumMeanAllTime. 
bufO - new Zbuffer ( "bufO", zl->getType(), zl->getSize(), 3 ); 
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allTimeSum = new Zbuffer( "allTimeSum", zl->getType(), zl->getSize(), 1 

); 

pZallTimeSum = allTimeSum->get( 0 ); 

} 

else 

allTimeSum->zero() ; 
return TRUE; 

} 

/* Returns the mean for all time in this file. 

*/ 

void NoveltyRT: :accumMeanAllTime() 

{ 

// Get average of energy AROUND time 1 . 
float energy = (float) 0.0; 
for(inti = 0;i<3; i++) 

energy += (float) bufO->get(i)->get(0); 
energy = (float) (energy / 3.0); 

/* Check fixed energy threshold. */ 
if (energy > 22) 

{ 

float *pfSum = (float*) pZallTimeSurn->getData(); 
allTimeCount++; 

for ( i = 0; i < (int) pZallTimeSum->getSize(); i++ ) 
{ 

float newVal = (float) bufO->get(l)->get(i); 
pfSumfi] += newVal; 

} 

} 

return; 

} 

float NoveltyRT ::getScaleMeanAllTime( int i ) 

{ 

float scaleSum = (float ) pZallTimeSum->get( i ); 
return (float) quo( scaleSum, allTimeCount ); 

} 

Zipper* NoveltyRT::processZipper(Zipper* zl, Zipper* z2) 

{ 

Zipper* zout = Zipper: :createZipper( ELIZA_FLOAT, outSize ); 
zout->zero(); 
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bSpeaking = FALSE; 

if(z2) bSpeaking = int(z2->get(0)); 

// Store the input data in memory. 

bufO->put( zl ); 

if(bSpeaking) { 

} else 

accumMeanAllTime(); 

// compute the multiscale NoveltyRT for each input point, 
iout = 0; 
theZout = zout; 

for (int b = 0; b < numberOfScales; b++) { 
if ( cScales[b] !=NULL) 

cScales[b]->update(zl ); 
if ( sScales[b] !=NULL) 

sScales[b]->update( zl ); 
universal( zl->getSize(), cScales[b], sScales[b], alpha[b] ); 
} 

return zout; 

} 

void NoveltyRT: :universal( int size, ScaleMean* center, ScaleMean* surround, double 
alpha ) 

{ 

double scaleMean, scaleMean2, theNovelty; 

if ( surround = NULL ) { 

for (int i = 0; i < size; i++ ) { 

scaleMean = center->get( i ); 
scaleMean2 = getScaleMeanAHTime( i ); 
theNovelty = scaleMean - alpha * scaleMean2; 
put( theNovelty ); 

} 

} 

else { 

for (int i = 0; i < size; i++ ) { 

scaleMean = center->get( i ); 
scaleMean2 = surround->get( i ); 
theNovelty = scaleMean - alpha * scaleMean2; 
put( theNovelty ); 

} 

} 

} 
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Usage - 

— > coincidenceRT — > with nameO | namel | etc. 

Function - 

*/ 

#include "StdAfx.h" 
#include <stdlib.h> 
#include <stdio.h> 
#include <string.h> 
# include <assert.h> 
#include <math.h> 

#include "speedObject.h" 
#include "eTrigger.h" 

class CoincidenceRT : public SpeedProcess 
{ 

public: 

CoincidenceRT(); 
~CoincidenceRT() ; 

int begin (); 

int beginFile(Zipper* zl, Zipper* z2); 
int final(); 

Zipper* processZipper (Zipper*, Zipper*); 

double get( int t, int f, int offset ) 

{ 

if (t<0) 

return 0.0; 

else 

return pin[ t * inputStride + offset + f ]; 

} 

public: 

int numberOfScales; 
int numberOfTimes; 
int gateStride; 
int columnS ize; 
int localFreqSize; 

private: 

int whichProcess; 
BOOL countMode; 
BOOLbSetSize; 
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int nTotal; 

int inputStride; 
int deltaWidth; 
int deltaS tep; 
float *pin; 
char* pGate; 
float *pout; 

float* getAddr( int t, int f, int offset ) { 

return pin + (t * inputStride + offset + f); 

} 

void put( double x ) { 
if ( countMode ) 
nTotal++; 

else 

*pout++ = (float) x; 

} 

void doFricatives2(); 
void doNonFricatives2(); 
void doVowels2(); 
void doGA(); 
void doNonFricatives(); 
void doVowels(); 
void doFricatives(); 
void dispatch(); 

void eCrossColumn( int delta, int tstart, int tstop, int fWidth, int whichScale); 
void eCrossColumn( eGateType eGate, int delta, int tstart, int tstop, int fWidth, int 
whichScale ); 

void selfAddLocalFreq( int tstart, int tstop, int localN, int whichScale ); 
void selfAddLocalFreq( eGateType eGate, int tstart, int tstop, int localN, int 
whichScale ); 

void crossAddLocalFreq( int delta, int tstart, int tstop, int fWidth, int whichScale ); 
void crossAddLocalFreq( eGateType eGate, int delta, int tstart, int tstop, int 
fWidth, int whichScale ); 

}; 

int CoincidenceRT::begin() 
{ 

deltaWidth = localFreqSize = 4; 
deltaStep= 1; 

numberOfScales = (int) parameters->AskUser("Number of scales from novelty", 
0.0, 10.0, 10.0); 
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numberOfTimes = (int) parameters->AskUser("Number of times in RF", 0.0, 
100.0, 100.0); 

gateStride = numberOfTimes * numberOfScales; 

localFreqSize = (int) parameters->AskUser("Local Frequency Size", 0.0, 100.0, 
100.0); . . 

whichProcess = parameters->askWords("GA nonfricatives vowels fricatives"); 
bSetSize = TRUE; 
return TRUE; 

} 

void CoincidenceRT::dispatch() 
{ 

switch (whichProcess) { 
case 0: 

doGAO; 
break; 

case 1: 

doNonFricativesO; 
break; 

case 2: 

doVowels(); 
break; 

case 3: 

doFricatives(); 
break; 

} 

} 

int CoincidenceRT::beginFile(Zipper* zl, Zipper* z2) 
{ 

// Simulate one run in countMode 
pin = (float *) zl->getData(); 
pGate - (char *) z2->getData(); 
if(bSetSize) 

^ columnSize = z 1 ->getSize() / ( numberOfScales * numberOfTimes ) ; 
inputStride = numberOfScales * columnSize; 

nTotal = 0; 
countMode = TRUE; 
dispatch(); 

countMode = FALSE; 
int nf = columnSize- 1; 
int nfl = nf / localFreqSize; 
bSetSize = FALSE; 

cout « "CoincidenceRT: stride " « inputStride; 
cout « " columnSize " « columnSize; 
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//cout « " nfl is " « nfl « " nTotal = " « nTotal; 
cout « endl; 

} 

return TRUE; 

} 

Zipper* CoincidenceRT::processZipper (Zipper* zl, Zipper* z2) 
{ 

pin = (float *) zl->getData(); 
pGate = (char *) z2->getData(); 

Zipper* zOut = Zipper: :createZipper( ELIZA_FLOAT, nTotal ); 
zOut->zero(); 

pout = (float *) zOut->getData(); 

//dist->increment( ehi[l] - ehi[0]); 

dispatch(); 

return zOut; 

} 

void CoincidenceRT: :doFricatives() 
{ 

//output size is 576 

eCrossColumn( ePlus, -1, 1, 12, 7,0); 
eCrossColumn( eMinus, 1, 0, 14, 13,2); 
eCrossColurrm( eDeltaMinus, -6, 6, 24, 6,2); 
eCrossColumn( eDeltaPlus, 1, 12, 23, 3,2); 
eCrossColumn( eDeltaMinus, 0, 3, 24, 2,3); 
eCrossColumn( eDeltaPlusM2, -5, 5, 24, 1,3); 
eCrossColurnn( eMinus, -5, 22, 24, 8,4); 
eCrossColumn( ePlus, 0, 8, 13, 1,4); 
eCrossColumn( eDeltaPlusP2, -7, 7, 24, 6,5); 
eCrossColumn( eDeltaPlus, 3, 0, 21, 16,5); 
eCrossColumn( ePlus, -5, 8, 24, 16, 5 ); 
selfAddLocalFreO( eDeltaMinus, 7, 24, 6,5); 
selfAddLocalFreq( 14, 24, 10 ; 

selfAddLocalFreO( eMinus, 1, 24, 5, 5 ); 
selfAddLocalFreO( eDeltaPlus, 1, 24, 8,2); 
selfAddLocalFreO( eDeltaMinus, 0, 22, 13, 1 ); 
selfAddLocalFreO( eMinus, 0, 7, 6, 1 ); 
selfAddLocalFreO( eDeltaMinus, 3, 24, 11,0); 
crossAddLocalFreO( eDeltaPlus, 2, 0, 22, 9, 1 ); 
crossAddLocalFreO( eDeltaMinus, 3, 0,21,15,1); 
crossAddLocalFreO( eDeltaPlusP2, 2, 0, 22, 6,2); 
crossAddLocalFreO( 1, 13, 23, 11,2); 

crossAddLocalFreO( -3, 3, 24, 5, 3 ); 

crossAddLocalFreO( -1, 1,24, 3,3); 



FIG. 15D 



crossAddLocalFreO( ePlus, -4, 4, 24, 12, 5 ); 
crossAddLocalFreO( ePlus, 3, 0,21,11,5); 
crossAddLocalFreO( eMinus, -2, 2,24,11,5); 

} 

void CoincidenceRT::doNonFricatives() 
{ 

//output size is 697 

eCrossColumn( eDeltaPlus, -7, 7, 16, 10,0); 
eCrossColumn( eMinus, 0, 0, 23, 10,0); 
eCrossColumn( -2, 2, 24, 4,0); 

eCrossColumn( ePlus, -7, 7, 17, 6,1); 
eCrossColumn( eDeltaPlus, -1, 14, 24, 10,1); 
eCrossColumn( eDeltaPlus, 1, 0, 23, 2,2); 
eCrossColumn( eDeltaMinus, 0, 0, 24, 4,2); 
eCrossColumn( eDeltaPlus, -1, 1, 24, 13,2); 
eCrossColumn( ePlus, 2, 0, 18, 10,4); 
eCrossColumn( eMinus, -5, 10, 24, 5,5); 
selfAddLocalFreO( ePlus, 4, 18, 17,0); 
selfAddLocalFreO( eDeltaMinus, 0, 24, 5,0); 
selfAddLocalFreO( eDeltaPlusM2, 5, 23, 6, 1 ); 
selfAddLocalFreq( 1,24, 4,2); 

crossAddLocalFreO( eMinus, 3, 0, 21, 5,0); 
crossAddLocalFreq( ePlus, -2, 2, 24, 12,0); 
crossAddLocalFreO( -4, 4, 24, 6,2); 

crossAddLocalFreO( 1, 0, 23, 5,2); 

crossAddLocalFreO( -2, 2, 24, 5, 3 ); 

crossAddLocalFreO( eDeltaPlus, 1, 0, 23, 6,4); 
crossAddLocalFreO( -4, 4, 24, 9,4); 

crossAddLocalFreO( -7, 7, 24, 8,4); 

crossAddLocalFreO( eDeltaPlus, -2, 2, 24, 3,4); 
crossAddLocalFreq( eDeltaPlusP2, -3, 3, 24, 10,4); 
crossAddLocalFreq( -6, 6, 24, 13, 5 ); 

crossAddLocalFreq( eDeltaPlus, 2, 9, 22, 13, 5 ); 

} 

void CoincidenceRT::doVowels() 
{ 

//output size is 696 

eCrossColumn( ePlus, -7, 7, 22, 9, 1 ); 
eCrossColumn( eDeltaPlusM2, -2, 2, 24, 5, 1 ); 
eCrossColumn( ePlus, 2, 0,21, 3,1); 
eCrossColumn( eMinus, -7, 17, 21, 4,2); 
eCrossColumn( eDeltaMinus, -4, 4, 24, 13,2); 
eCrossColumn( eDeltaPlus, -7, 7, 24, 6,3); 
eCrossColumn( -7, 7, 12, 6,3); 
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eCrossColumn( eMinus, -6, 6, 24, 4, 3 ); 
eCrossColumn( eDeltaMinus, -2, 2, 24, 10,4); 
selfAddLocalFreO( eDeltaPlusP2, 5, 23, 16,4); 
selfAddLocalFreO( ePlus, 2, 24, 3, 5 ); 
selfAddLocalFreO( eDeltaMinus, 6, 24, 16,5); 
selfAddLocalFreO( eDeltaMinus, 0, 21, 16,0); 
selfAddLocalFreq( 3, 24, 6, 1 ); 

selfAddLocalFreO( ePlus, 0, 24, 9, 1 ); 
crossAddLocalFreO( -4, 4, 24, 5, 1 ); 

crossAddLocalFreO( eDeltaPlus, -4, 4, 24, 7, 1 ); 
crossAddLocalFreO( eDeltaPlus, -3, 3, 23, 5,2); 
crossAddLocalFreO( ePlus, 2, 0, 22, 7,2); 
crossAddLocalFreO( ePlus, -2, 2, 24, 5,3); 
crossAddLocalFreO( eMinus, -3, 3, 24, 13, 3 ); 
crossAddLocalFreO( eDeltaPlusP2, 1, 0,23, 8,3); 
crossAddLocalFreO( eMinus, 1, 0, 23, 5,4); 
crossAddLocalFreO( eDeltaPlus, -2, 2, 24, 6,4); 
crossAddLocalFreO( ePlus, -2, 2, 24, 4, 5 ); 
crossAddLocalFreO( eMinus, -3, 3, 24, 9,5); 

} 

void CoincidenceRT::doGA() 

{ 

//doVowels(); 

//doFricatives(); 
// doNonFricatives(); 
} 

void CoincidenceRT::eCrossColumn( int delta, int tstart, int tstop, int fWidth, int 

whichScale=0 ) 

{ 

int scaleBase = whichScale * columnSize; 

// Energy by itself 

double sum = 0.0; 

for ( int t = tstart; t < tstop; t++ ) 

sum += get( t, 0, scaleBase ) * get( t+delta, 0, scaleBase ); 
put( sum ); 

for ( int f = 1; f <= columnSize-fWidth; f += fWidth ) 
{ 

sum = 0.0; 

for ( int t = tstart; t < tstop; t++ ) 

{ 

float* pi = getAddr( t, 0, scaleBase ); 
float* p2 = getAddr( t+delta, f, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) 
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sum += *pl * *p2++; 
} 

put( sum ); 

} 

} 

// N = 1 + numberOfFreqs/fWidth 

void CoincidenceRT::eCrossColumn( eGateType eGate, int delta, int tstart, int tstop, int 

fWidth, int whichScale=0 ) 

{ 

int scaleBase = whichScale * columnSize; 

int outOffset = whichScale * numberOfTimes; 

char* eGateA = pGate + gateStride * eGate + outOffset; 

// Energy by itself 
double sum = 0.0; 

int stop = min( numberOfTimes- 1 -delta, tstop ); 
int start = max( 0-delta, tstart); 
for ( int t = start; t < stop; t++ ) { 

sum += get( t, 0, scaleBase ) * get( t+delta, 0, scaleBase ); 

} 

put( sum ); 

for ( int f = 1 ; f <= columnSize-fWidth; f += fWidth ) 
{ 

sum = 0.0; 

for ( int t = start; t < stop; t++ ) 
{ 

if ( eGate A[t] ) { 

float* p2 = getAddr( t+delta, f, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) { 
sum += *p2++; 

} 

} 

} 

put( sum ); 

} 

} 

void CoincidenceRT::selfAddLocaLFreq( int tstart, int tstop, int localN, int whichScale ) 
{ 

int scaleBase = whichScale * columnSize; 

// Do full self product, but amalgamate by localN 
for ( int fl = 1; fl< columnSize-localN; fl += localN ) 
{ 
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for ( int £2 = 1; £2 <= fl; £2 += localN ) 
{ 

double sum = 0.0; 

for ( int t = tstart; t < tstop; t++ ) 

{ 

float* pi = getAddr( t, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < localN; i++ ) 
sum += *pl++ * *p2++; 

} 

put( quo( sum, tstop - tstart ) ); 

} 

} 

} 

// N = ( numberOfFreqs / localN ) * ( numberOfFreqs / localN - 1 ) / 2 
void CoincidenceRT::selfAddLocalFreq( eGateType eGate, int tstart, int tstop, int fWidth, 
int whichScale ) 
{ 

int scaleBase = whichScale * columnSize; 

int outOffset = whichScale * numberOfTimes; 

char* eGateA = pGate + gateStride * eGate + outOffset; 

// Do full self product, but amalgamate by fWidth 
for ( int fl = 1; fl< columnSize-fWidth; fl += fWidth ) { 
for ( int £2 = 1; £2 <= fl; £2 += fWidth ) { 
double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) { 
if( eGate A[t]) { 

float* pi = getAddr( t, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) { 
sum+=*pl++* *p2++; 

} 

} 

} 

put( sum ); 

} 

} 

} 

// N = ( numberOfFreqs / fWidth ) * *2 

void CoincidenceRT::crossAddLocalFreq( int delta, int tstart, int tstop, int fWidth, int 
whichScale ) 
{ 

int scaleBase = whichScale * columnSize; 
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// Do foil cross product, but amalgamate by 2s 
for ( int fl = 1; fl <= columnSize - fWidth; fl += fWidth ) 
{ 

for ( int £2 = 1; £2 <= columnSize - fWidth; £2 += fWidth ) 
{ 

double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) 
{ 

float* pi = getAddr( t+delta, fl, scaleBase ); 
float* p2 = getAddr( t, f2, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) 
sum += *pl++ * *p2++; 

} 

put( sum ); 

} 

} 

} 



void CoincidenceRT::crossAddLocalFreq( eGateType eGate, int delta, int tstart, int tstop, 
int fWidth, int whichScale ) 

{ 

int scaleBase = whichScale * columnSize; 

int outOffset = whichScale * numberOfTimes; 

char* eGateA = pGate + gateStride * eGate + outOffset; 

// Do full cross product, but amalgamate by 2s 

for ( int fl = 1; fl <= columnSize - fWidth; fl += fWidth ) { 

for ( int f2 = 1; £2 <= columnSize - fWidth; £2 += fWidth ) { 
double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) { 
if ( !eGateA[t] ) continue; 

float* pi = getAddr( t+delta, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) 
sum += *pl++ * *p2++; 

} 

put( sum ); 
} 



} 

} 
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